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1 . A reliable symbol identification method for use in a communication system for 
transmitting symbols of a high order constellation comprising: 

estimating decoded symbols from a sequence of captured samples representing a 
communication signal captured at a receiver, 

calculating a reliability factor of a candidate sample from values of a plurality of 
estimated symbols in proximity to an estimated symbol that corresponds to the candidate 
sample, 

if the reliability factor is less than a predetermined limit, designating the candidate 
sample as a reliable symbol. 

2. The method of claim 1, wherein the reliability factor R of the candidate sample 
x n is given by: 

R(x n )= li—ki^o^ | d A n -i | c i? where 
d A n -i is an estimated symbol, 

Ki ( K2 are number of estimated symbols adjacent to symbol d A n , and 

c, is a coefficient representing any prior knowledge of intersymbol interference 

effects. 

3. The method of claim 2, wherein Ki = 0. 
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4. The method of claim 1, wherein the reliability of a two-dimensional candidate 
sample x n is given by: 

R(x„) = Z i - -ki, i * o U (Vdi Vi 2 + d 2 A n -i 2 ) Ci , where 
d] Vi and d2 A n -i respectively represent values of an estimated symbol d A n -i in first and 
second dimensions, 

Kl, K2 are the number of estimated symbols adjacent to symbol d A n , and 

Ci is a coefficient representing any prior knowledge of intersymbol interference effects. 

5. The method of claim 1, wherein the estimating comprises: 
rescattering the captured samples according to currently known IS I effects, and 

generating estimated symbols from the rescattered samples according to decision regions of a 
governing constellation. 

6. The method of claim 1, wherein the estimating comprises generating estimated 
symbols according to a maximum likelihood analysis of conditional probabilities of a 
captured sample conditioned upon all possible sets of surrounding transmitted symbols and 
the ranges of all possible ISI coefficients, for all possible values of the captured sample. 

7. The method of claim 1, wherein the estimation comprises generating estimated 
symbols according to trellis decoding based upon all possible sets of surrounding transmitted 
symbols and the ranges of all possible ISI coefficients, for all possible values of the captured 
sample. 
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8. The method of claim 1, wherein the estimating comprises generating estimated 
symbols according to a maximum likelihood analysis of conditional probabilities of a 
captured sample conditioned upon all possible sets of surrounding transmitted symbols and 
the ranges of all possible ISI coefficients, and a uniform distribution of ISI coefficients for all 
possible values of the captured sample 

9. The method of claim 1, wherein the estimation comprises generating estimated 
symbols according to a maximum likelihood analysis of conditional probabilities of a 
captured sample conditioned upon past symbol decisions and the ranges of all possible ISI 
coefficients, for all possible values of the captured sample. 

10. A reliable symbol identification method for use in a communication system for 
transmitting symbols of a high order constellation comprising: 

estimating decoded symbols from a sequence of captured samples representing a 
communication signal captured at a receiver, 

calculating a reliability factor of a candidate sample from values of a plurality of 
decoded symbols in proximity to the candidate sample, 

if the reliability factor is less than a predetermined limit, designating the candidate 
sample as a reliable symbol. 

1 1 . The method of claim 10, wherein the reliability factor R of the candidate 
sample x„ is given by: 

R(x n )= Ii = -ki,i*o k2 | d A n .i | c is where 
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d A n .j is a decoded symbol, 

Ki ( K 2 are number of decoded symbols adjacent to symbol d A n , and 

Cj is a coefficient representing any prior knowledge of intersymbol interference 

effects. 

12. The method of claim 11, wherein Ki = 0. 

13. The method of claim 10, wherein the reliability of a two-dimensional candidate 
sample x n is given by: 

R(xn) = Z i = -ki, i * o " (Vd, A n _, 2 + d 2 A n-i 2 ) c s , where 
di A n -i and d2 A n -i respectively represent values of a decoded symbol d A n _i in first and 
second dimensions, 

KI, K2 are the number of decoded symbols adjacent to symbol d A n , and 

Cj is a coefficient representing any prior knowledge of intersymbol interference effects. 

14. The method of claim 10, wherein the estimation comprises: 
rescattering the captured samples according to currently estimated ISI effects, and 
generating estimated symbols from the rescattered samples according to decision 

regions of a governing constellation. 

15. The method of claim 10, wherein the estimating comprises generating 
estimated symbols according to a maximum likelihood analysis of conditional probabilities of 
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a captured sample conditioned upon all possible sets of surrounding transmitted symbols and 
the ranges of all possible ISI coefficients, for all possible values of the captured sample. 

16. The method of claim 10, wherein the estimating comprises generating 
estimated symbols according to trellis decoding based upon all possible sets of surrounding 
transmitted symbols and the ranges of all possible ISI coefficients, for all possible values of 
the captured sample. 

17. The method of claim 10, wherein the estimating comprises generating 
estimated symbols according to a maximum likelihood analysis of conditional probabilities of 
a captured sample conditioned upon all possible sets of surrounding transmitted symbols and 
the ranges of all possible ISI coefficients, and a uniform distribution of ISI coefficients for all 
possible values of the captured sample 

18. The method of claim 10, wherein the estimating comprises generating 
estimated symbols according to a maximum likelihood analysis of conditional probabilities of 
a captured sample conditioned upon past symbol decisions and the ranges of all possible ISI 
coefficients, for all possible values of the captured sample. 

1 9. An equalization method for use in a communication system for transmitting 
symbols of a high order constellation, comprising: 
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estimating decoded symbols from captured samples based on a set of ISI coefficient 
estimates, the captured samples representing a communication signal captured at a receiver, 
and 

revising the ISI coefficients based on the decoded symbols and corresponding received 
sample values, wherein the contribution of each symbol-sample pair is weighted according to 
reliability factor of the respective captured sample. 

20. The equalization method of claim 19, wherein the weighting of a 
symbol-sample pair comprises: 

comparing the reliability factor of a candidate sample to a threshold, and 
assigning a first weight value to the symbol-sample pair if the reliability factor is less 
than or equal to the threshold, and 

otherwise, assigning a second weight value to the symbol-sample pair. 

21 . The equalization method of claim 19, wherein the weighting of a 
symbol-sample pair is inversely proportional to the reliability factor of the candidate sample. 

22. The equalization method of claim 19, wherein the weighting of a candidate 
sample comprises: 

comparing the reliability factor of the candidate sample to a threshold, and 
assigning a first weight value to the symbol-sample pair if the reliability factor is less 
than or equal to the threshold, and 
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otherwise, assigning a second weight value to the symbol-sample pair, the second 
weight being inversely proportional to the reliability factor of the candidate sample. 

23. Cancelled. 

24. The equalization method of claim 19, wherein the reliability factor of a 
candidate sample x n is determined from values of neighboring samples. 

25. The equalization method of claim 24, wherein the reliability factor R of a 
candidate sample x n is given by: 

R(x n )= Ii = -ki,i*o k2 | x n -i | c i? where 
x n -i is a value of a surrounding sample, 

Ki, K 2 represent numbers of samples adjacent to sample x n , and 

Cj is a coefficient representing any prior knowledge of intersymbol interference 

effects. 

26. The equalization method of claim 24, wherein the reliability factor R of a 
candidate sample x n is given by: 

R(x n )= Zi = i k | Xn-i | where 
x n .j is a value of a surrounding sample, 

K represents a number of samples neighboring to sample x n , and 

Cj is a coefficient representing any prior knowledge of intersymbol interference 

effects. 
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27. The equalization method of claim 24, wherein the reliability factor R of a 
candidate sample x n is given by: 

R(*n) = Z i = -ki, i * o ^ (V xl n _i 2 + x2 n _i 2 ) Cj , where 

xl n ,j and x2 n .j respectively represent values of a capturedsample x n -i in first second 
dimensions, 

K t( K 2 represent numbers of samples neighboring to sample x n , and 

Cj is a coefficient representing any prior knowledge of intersymbol interference 

effects. 

28. The method of claim 27 where Ki = 0. 

29. The equalization method of claim 19, wherein the reliability factor of a 
candidate sample x n is determined from values of estimated symbols d A n _j neighboring the 
candidate sample. 

30. The equalization method of claim 29, wherein the reliability factor R of a 
candidate sample x n is given by: 

R ( x n)= Zi^-ki.i^o 1 * 2 | d A n -i | where 
d A n -i is a value of an estimated symbol, 

Ki, K 2 represent numbers of estimated symbols neighboring to symbol d A n , and 
Cj is a coefficient representing any prior knowledge of intersymbol interference 

effects. 
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3 1 . The equalization method of claim 29, wherein the reliability factor R of a 
candidate sample x n is given by: 

R(x n )= Ii = i k | d A n .i | c is where 
d A n -i is a a value of an estimated symbol, 

K represents a number of estimated symbols neighboring to symbol d A n , and 
Cj is a coefficient representing any prior knowledge of intersymbol interference 

effects. 

32. The equalization method of claim 29, wherein the reliability factor R of a 
candidate sample x n is given by: 

R(x n )= Zi^kui^o^CVd^n, 2 +d 2 A n-i 2 )ci,where 

di A n _j and d2 A n -i respectively represent values of an estimated symbol d A n -i in first and 
second dimensions, 

Kl, K2 represent the number of estimated symbols neighboring to symbol d A n , and 
Cj is a coefficient representing any prior knowledge of intersymbol interference effects. 

33. The method of claim 32 where Ki = 0. 

34. The equalization method of claim 19, wherein the estimating comprises: 
rescattering the captured samples according to the set of ISI coefficient estimates, 

estimating symbols from the rescattered samples according to decision regions of a 
governing constellation. 



9 



35. The equalization method of claim 34, wherein the reliability factor R of a 
candidate sample x n is given by: 

R(*n) = Si = -ki,i*o k2 | Yn-i I Ci, where 
y n -i is a value of a rescattered sample, 

Ki t K2 represent numbers of rescattered samples neighboring to rescattered sample 

and 

Cj is a coefficient representing any prior knowledge of intersymbol interference 

effects. 

36. The equalization method of claim 34, wherein the reliability factor R of a 
candidate sample x n is given by: 

R(x n ) = Zi = i k I Yn-i I where 
y n .i is a value of a rescattered sample, 

K represents a number of rescattered samples neighboring to rescattered sample y n . 

and 

Ci is a coefficient representing any prior knowledge of intersymbol interference 

effects. 

37. The equalization method of claim 34, wherein the reliability factor R of a 
candidate sample x n is given by: 

R(x n ) =Zi = -ki,i^o k2 (Vyl n -i 2 + y 2 n .i 2 ) Ci , where 



yl n .i and y2 n _j respectively represent values of a rescattered sample y n .i in first second 
dimensions, 

Ki, K2 represent numbers of rescattered samples neighboring to rescattered sample y n , 

and 

q is a coefficient representing any prior knowledge of intersymbol interference 

effects. 

38. The equalization method of claim 19, wherein the estimation comprises 
generating decoded symbols according to a computational approximation of: 

Pr(x n |h n k ) =Z D( n + ki,n-k2)Ja[(l/V2^a 2 ) e- ( " )2/2a2 p r (a) Pr(D (n+k 1 , n - k2)) ] da, 

where 

h n k represents a k th estimate of the captured sample x n , 

k is an index running from a first value - Ki to a second value K2, and 

D (n+kl,n-k2)= { h n+k i, h n+ i 5 h n _ 1? ... h n - k 2}, 

o 2 represents a variance in channel noise, and 

Pr(a) is a probability density function of the ISI coefficients aj. 

39. The equalization method of claim 19, wherein the estimating and the revising 
operate on captured samples and estimated symbols on a frame-by-frame basis. 

40. The equalization method of claim 39, wherein the frames each contain a 
uniform number of captured samples and estimated symbols. 
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41 . The equalization method of claim 39, further comprising: 
designating captured samples as reliable symbols based on the captured samples 1 

reliability factors, and 

assembling a frame to include a set of captured samples and a set of reliable symbols 
from a preceding frame. 

42. The equalization method of claim 39, further comprising: 
designating captured samples as reliable symbols based on the captured samples 1 

reliability factors, and 

assembling a frame to include a set of captured samples and a set of reliable symbols 
from multiple preceding frames. 

43. The equalization method of claim 39, wherein frame lengths vary according to 
a regular progression of predetermined lengths. 

44. An equalizer for use in a communication system for transmitting symbols of a 
high order constellation, comprising: 

a symbol decoder having a first input for captured samples, a second input for 
estimated ISI coefficients and an output for estimated symbols, 

an ISI estimator having a first input coupled to the symbol decoder output, a second 
input coupled to the first input of the symbol decoder and an output for the estimated ISI 
coefficients, wherein the ISI estimator estimates ISI coefficients based on the decoded 
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symbols and corresponding received sample values, each symbol-sample pair being weighted 
according to reliability factor of the respective captured sample. 

45. The equalizer of claim 44, wherein the symbol decoder comprises a subtractive 
equalizer coupled to a decision unit. 

46. The equalizer of claim 44, wherein the symbol decoder comprises a maximum 
likelihood estimator coupled to a decision unit. 

47. The equalizer of claim 46, wherein the maximum likelihood analysis is made 
having assigned a uniform probability distribution for ISI coefficients over their ranges. 

48. The equalizer of claim 46, wherein the maximum likelihood analysis is made 
having assigned previously decoded symbols to occur with probability equal to one. 

49. The equalizer of claim 44, wherein the symbol decoder comprises a trellis 
decoder coupled to a decision unit. 

50. The equalizer of claim 44, wherein the symbol decoder generates decoded 
symbols according to a computational approximation of: 

Pr(x n |h n k ) -lD(n + ki,n-k2)Ja[(l/V2 7ia 2 ) e ' ( ) 2/2ct2 Pr(a) Pr(D (n+k 1 , n - k2)) ] da, 

where 

h n k represents a k th estimate of the captured sample x n , 
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k is an index running from a first value - Ki to a second value K2, 

D (n+kl,n-k2)= { h n+k ,, ... h n+ ,,h n .i, ... h n . k2 }, 

a represents a variance in channel noise, and 

Pr(a) ) is a probability density function of the ISI coefficients aj. 

5 1 . The equalizer of claim 44, further comprising a reliable symbol detector 
having an input coupled to the first input of the symbol decoder and an output that enables the 
symbol decoder. 

52. A receiver for use in a communication system for transmitting symbols of a 
high order constellation, comprising: 

a demodulator to generate captured samples from a communication signal received via 
a channel, 

a memory system coupled to the demodulator, the memory system logically organized 
as a captured sample buffer and a decoded symbol buffer, and 

a processor coupled to the memory by a communication path, the processor logically 
organized as a reliable symbol detector, an ISI estimator and a symbol decoder, the reliable 
symbol detector to identify which of the captured samples are likely to be located within a 
correct decision region of a constellation notwithstanding ISI effects of the channel, the ISI 
estimator to estimate the ISI effects based on the symbols so identified by the reliable symbol 
detector and the symbol decoder to generate decoded symbols from captured samples using 
estimated ISI effects. 
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53. The receiver of claim 52, wherein the symbol decoder is embodied as a 
subtractive equalizer coupled to a decision unit. 

54. The receiver of claim 52, wherein the symbol decoder is embodied as a 
maximum likelihood estimator. 

55. The receiver of claim 54, wherein the maximum likelihood estimator assigns a 
uniform probability distribution for ISI coefficients over their ranges. 

56. The receiver of claim 54, wherein the maximum likelihood estimator assigns to 
occurrence of previously decoded symbols a probability of occurrence equal to one. 

57. The receiver of claim 52, wherein the symbol decoder is embodied as a trellis 
decoder. 

58. The receiver of claim 52, wherein the symbol decoder generates decoded 
symbols according to a computational approximation of: 

Pr(x n |h n k ) =ZD(n + ki ( n-k2)Ja[(l/V2 7ca 2 ) e - ( " )2/2a2 Pr(a) Pr(D (n+kl, n - k2)) ] da, 

where 

h n k represents a k th estimate of the captured sample x n , 

k is an index running from a first value - Ki to a second value K2, and 

D (n+kl,n-k2) = { h n+k i, ... h n+ i,h n _i, ... h^}, 

a 2 represents a variance in channel noise, and 
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Pr(a) is a probability density function of the ISI coefficients a\. 

59. A computer readable medium having instructions stored thereon that, when 
executed by processing unit, causes a symbol estimation method to be executed in a 
communication system for transmitting symbols of a high order constellation: 

estimating decoded symbols from a sequence of captured samples and a set of 
estimated ISI coefficients, and 

revising the estimated ISI coefficients based on the decoded symbols and 
corresponding received sample values, wherein a contribution of each symbol-sample pair to 
the revision is weighted according to reliability factors of the respective captured sample. 

60. The medium of claim 59, wherein the weighting of a symbol-sample pair 
comprises: 

comparing the reliability factor of a candidate sample to a threshold, and 
assigning a first weight value to the symbol-sample pair if the reliability factor is less 
than or equal to the threshold, and 

otherwise, assigning a second weight value to the symbol-sample pair. 

61 . The medium of claim 59, wherein the weighting of a symbol-sample pair is 
inversely proportional to the reliability factor of the candidate sample. 

62. The medium of claim 59, wherein the weighting of a candidate sample 
comprises: 
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comparing the reliability factor of the candidate sample to a threshold, and 
assigning a first weight value to the symbol-sample pair if the reliability factor is less 

than or equal to the threshold, and 

otherwise, assigning a second weight value to the symbol-sample pair, the second 

weight being is inversely proportional to the reliability factor of the candidate sample. 

63. The medium of claim 59, wherein the reliability factor of a candidate sample is 
determined from values of samples neighboring the candidate sample. 

64. The medium of claim 59, wherein the reliability factor of a candidate sample 
x n is determined from values of estimated symbols d A n .i neighboring the n th estimated symbol. 

65. The medium of claim 59, wherein the estimating comprises: 
rescattering the captured samples according to the set of IS I coefficients, 
estimating symbols from the rescattered samples according to decision regions of a 

governing constellation. 

66. The medium of claim 59, wherein the estimating comprises: 
rescattering the captured samples according to currently known ISI effects, and 
generating estimated symbols from the captured samples according to decision regions 

of a governing constellation. 
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67. The medium of claim 59, wherein the estimating comprises generating 
decoded symbols according to a computational approximation of: 

Pr(x n |h n k ) -ZD(n4-ki,n-k2)Ja[(l/V27ra 2 ) ^ 2/2a2 Pr(a)Pr(D(n+kl 5 n-k2))]da, 

where 

h n k represents a k th estimate of the captured sample x n , 

k is an index running from a first value - Ki to a second value K2, 

D (n+kl,n-k2)= { h n +ki, ... h n+ i,h n -i, h n - k 2}, 

o 2 represents a variance in channel noise, and 

Pr(a) is a probability density function of the ISI coefficients a it 

68. The medium of claim 59, wherein the estimating and the revising operate on 
frames of captured samples and estimated symbols on a frame-by- frame basis. 

69-72. Cancelled. 

73. A framing method for use in a communication system for transmitting symbols 
of a high order constellation, comprising: 

identifying reliable symbols from a first frame of captured samples, 

following processing of the first frame, generating a second frame of captured 
samples, the second frame comprising the reliable symbols from the first frame and a second 
set of captured samples, wherein the identifying comprises: 

estimating decoded symbols from a sequence of captured samples representing a 
communication signal captured at a receiver, 
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calculating a reliability factor of a candidate sample from values of a plurality of 
estimated symbols in proximity to an estimated symbol that corresponds to the candidate 
sample, 

if the reliability factor is less than a predetermined limit, designating the candidate 
sample as a reliable symbol. 

74. The framing method of claim 73, further comprising: 

identifying reliable symbols from the second frame of captured samples, and 
assembling a third frame from a third set of captured samples and the reliable symbols 
from the second frame. 

75. The framing method of claim 74, wherein the third set also includes reliable 
symbols from the third frame. 
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